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SOURCE-RELAY  OPTIMIZATION  FOR  A  TWO-WAY  MIMO  RELAY  SYSTEM 


Shengyang  Xu,  Yingbo  Hua 
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ABSTRACT 

This  paper  addresses  a  non-regenerative  two-way  MIMO  re¬ 
lay  system  where  two  sources  exchange  information  via  a 
common  relay.  Both  sources  and  the  relay  are  each  equipped 
with  multiple  antennas.  In  the  first  phase  (time  or  frequency), 
both  sources  transmit  their  signals  and  the  relay  receives.  In 
the  second  phase,  the  relay  transmits  towards  both  sources  a 
transformed  signal.  The  optimization  of  the  source  covariance 
matrices  and  the  optimization  of  the  relay  transformation  ma¬ 
trix  can  be  performed  alternately  until  convergence.  The  for¬ 
mer  can  be  achieved  by  a  generalized  water  filling  algorithm, 
and  the  latter  can  be  achieved  by  two  algorithms  discussed  in 
this  paper.  The  first  algorithm  is  a  hybrid  gradient  optimiza¬ 
tion.  The  second  algorithm  is  an  iterative  weighted  MMSE 
equalization.  It  is  shown  in  simulation  that  both  algorithms 
converge  to  the  same  results  and  are  much  faster  than  a  prior 
algorithm  developed  for  single-antenna  sources. 

Index  Terms —  Two-way  relay,  maximum  sum  rate,  hy¬ 
brid  gradient,  iterative  WMMSE,  generalized  water-filling  al¬ 
gorithm. 

1.  INTRODUCTION 

Non-regenerative  MIMO  relays  have  attracted  a  lot  of  atten¬ 
tions  recently,  e.g.,  see  [1]-  [4]  and  the  references  therein.  A 
key  advantage  of  non-regenerative  relays  over  regenerative  re¬ 
lays  is  the  simplicity  and  short  delay.  If  all  channel  state  in¬ 
formation  is  available,  the  optimality  of  diagonalization  for  a 
non-regenerative  MIMO  relay  system  of  any  number  of  hops 
is  established  in  [4].  A  non-regenerative  MIMO  relay  system 
with  multiple  users  each  with  multiple  antennas  is  addressed 
in  a  recent  work  [5]. 

In  this  paper,  we  consider  a  new  form  of  non-regenerative 
MIMO  relays  where  two  sources  each  with  multiple  antennas 
exchange  information  via  a  common  non-regenerative  relay 
also  with  multiple  antennas.  Referred  to  as  two-way  MIMO 
relays,  this  problem  is  more  complex  than  that  in  [6]  where 
the  sources  and  the  relay  are  each  with  a  single  antenna.  It 
is  also  more  complex  than  that  in  [7]  and  [8]  where  only  the 

This  work  was  supported  in  part  by  NSF  Grant  No.  TF-05 14736,  the 
ARL  CTA  Program  and  and  the  ARO  under  the  MURI  Grant  W91  lNF-04- 
1-0224. 


relay  has  multiple  antennas  and  the  two  sources  each  have  a 
single  antenna. 


Fig.  1.  A  non-regenerative  two-way  MIMO  relay  system  where 
and  S2  are  the  source  nodes  and  the  relay  node  is  also  referred  to  as 
R. 

Eor  this  problem,  we  focus  on  the  computation  of  the 
source  covariance  matrices  and  the  relay  transformation  ma¬ 
trix  to  maximize  the  sum  capacity  of  the  system.  We  follow  an 
approach  where  the  source  covariance  matrices  and  the  relay 
matrix  are  optimized  alternately  until  convergence.  Although 
the  optimality  of  this  approach  is  not  established,  there  ap¬ 
pears  no  other  method  so  far  that  yields  better  results.  Given 
any  fixed  relay  matrix,  the  problem  of  optimizing  the  source 
covariance  matrices  can  be  done  by  a  generalized  water  fill¬ 
ing  algorithm  developed  in  [5].  Eor  a  fixed  pair  of  source 
covariance  matrices,  we  have  developed  two  algorithms  to 
find  the  optimal  relay  matrix.  The  first  algorithm  is  a  hy¬ 
brid  gradient  method  that  dynamically  switches  between  the 
steepest  descent  and  the  Newton’s  descent.  Simulation  shows 
that  using  the  Newton’s  descent  alone  can  lead  to  a  bad  con¬ 
vergence  point.  The  hybrid  gradient  method  takes  the  advan¬ 
tage  of  both  the  steepest  descent  and  the  Newton’s  descent. 
The  second  algorithm  extends  an  idea  discussed  in  [9]  from 
broadcast  beamforming  to  two-way  MIMO  relay,  where  the 
relay  matrix  and  the  linear  equalizers  at  the  two  sources  are 
optimized  alternately  via  a  weighted  minimum  mean  square 
error  (WMMSE)  problem.  The  second  algorithm  is  referred 
to  as  iterative  WMMSE  algorithm.  Due  to  space  limitation, 
we  will  only  present  the  second  algorithm  in  this  paper. 

Our  simulation  shows  that  both  algorithms  yield  the  same 
results  upon  convergence.  However,  the  first  algorithm  con¬ 
verges  much  faster  when  the  results  are  near  optimal,  which 
is  expected  due  to  the  Newton  descent,  and  the  second  al¬ 
gorithm  converges  much  faster  when  the  results  are  not  near 
optimal.  Both  algorithms  are  useful  depending  on  the  ac- 


curacy  requirement.  Naturally,  they  can  be  combined  to 
achieve  a  better  overall  performance.  We  have  also  compared 
our  algorithms  with  that  developed  in  [8]  for  single-antenna 
sources.  Simulation  shows  that  both  of  our  algorithms  have 
much  faster  convergence  rate  than  that  in  [8]  . 

The  rest  of  this  paper  is  organized  into  sections  of  sys¬ 
tem  model  and  problem  formulation,  relay  optimization  with 
fixed  sources,  source  optimization  with  fixed  relay,  simulation 
results,  and  conclusion. 

2.  SYSTEM  MODEL  AND  PROBLEM 
FORMULATION 


s-t-  Pr  <  Pr  and  <  Pi,  i  =  1,  2,  where  Pr  and  Pi 

denote  the  maximum  available  power  at  R  and  Si .  Weighted 
sum  rate  can  be  treated  similarly.  We  will  follow  the  approach 
that  finds  the  optimal  F  and  the  optimal  for  i  =  1,  2  alter¬ 
nately  until  convergence. 

3.  RELAY  OPTIMIZATION  WITH  FIXED  SOURCE 

In  this  section,  we  consider  the  optimization  of  F  with  fixed 
Ri  for  i  =  1,  2. 

3.1.  Optimal  Structure  of  the  Relay  Matrix 


The  relay  system  is  illustrated  in  Fig.  1  where  all  channels 
are  flat  fading  channels  within  the  bandwidth  of  interest.  The 
source  nodes  S'!  and  S2  exchange  their  symbol  vectors  Si  and 
S2  via  the  relay  node  R  using  two  phases,  where  G 
and  E[sis|^]  =  I,  i  =  1,2.  In  the  first  phase,  both  the 
source  nodes  transmit,  and  the  transmitted  signal  from  Si  is 
Xi  =  PiSi,  where  G  is  the  transmit  beamforming 

matrix  from  Si,  and  R^;.  =  is  the  source  covariance 

matrix  from  Si.  Also  in  the  first  phase,  the  relay  receives 
HirXi  -I-  H2RX2  +  Hr  where  Ur  €  is  the  noise 

at  the  relay  and  we  assume  iir  ~  CA/^(0,I).  In  the  second 
phase,  the  relay  uses  the  transformation  matrix  F  € 
and  transmits  xr  =  FHirXi  +  FH2RX2  +  Fur  where 
HiR  G  denotes  the  channel  matrix  from  Si  to  R.  The 

power  consumed  at  the  relay  is 


PR  =  Tr(FHiRR,,HfRF^  +  FH2RR,,HfRF^  +  FF^). 

Also  in  the  second  phase.  Si  receives  Hr^xr  +  Ui  where 
Hr^  G  is  the  channel  matrix  from  R  to  Si  and  rii  G 

i^Nxi  j-jjg  noise  at  Si.  We  also  assume  ~  CA/'(0,I). 
Since  Si  knows  HR^FH^RXi  (which  is  a  feasible  assump¬ 
tion),  Si  can  subtract  it  out  from  Hr^xr  +  Ui  and  the  net 
signals  received  at  Si  and  S2  are 


Theorem  3.1  in  [8]  is  valid  for  sources  each  with  a  single 
antenna.  The  following  is  a  generalization  of  that  theo¬ 
rem  from  single  antenna  to  multiple  antennas  at  the  source 
nodes.  Assuming  M  >  2N  and  using  QR  decompo¬ 
sition,  we  can  obtain  that  Hr2]  =  ViRi  and 

[Hir  H2r]  =  U2R2  where  Ri,R2  G  C^nx2N 
triangular,  and  Vi,U2  G  are  orthonormal.  Then, 

we  have  the  following  theorem 

Theorem  1.  If  M  >  2N,  the  optimal  relay  matrix  F  that 
maximizes  the  sum  rate  rgum  has  the  following  structure: 

F  =  ViAUf  (5) 

where  A  G 


The  proof  is  available  in  [10].  Thus,  if  the  condition  M  > 
2N  is  satisfied,  we  only  need  to  determine  A  with  47V^  un¬ 
known  elements  instead  of  in  F.  This  can  greatly  reduce 
the  computational  load.  To  unify  the  structure  of  the  problem 
regardless  of  whether  M  >  2N  is  satisfied,  we  will  write 


F  =  SAT^where 


S  =  Vi,T  =  U2  ifM>27V 
S  =  T  =  I  ifM<27V 

(6) 


also  define  Gri  =  HriS,  Gr2  =  Hr2S,  Gir  =  T^Hir, 
G2R  =  T^H2r.  Then,  the  signal  models  become 


yi  =  HR1FH2RX2 -I- HriFur  +  ni  (1) 

y2  =  HR2FH1RX1  -f  HR2FnR  +  n2  (2) 


yi  =  GR1AG2RX2 -I- GriAhr  +  Hi  (7) 

y2  =  GR2AG1RX1 -I- GR2AnR -f  n2  (8) 


The  maximum  achievable  rates  in  bits/s/Hz;  r2i  from  S2 
to  Si,  and  ri2  from  Si  to  S2,  can  be  expressed  as  r2i  = 
5  log2  det  Xi  and  ri2  =  |  log2  det  X2  where 

Xi  =  I  +  R|H2V^Hgi 

(HRiFF^Hfi-fI)-iHRiFH2RRi  (3) 


where  =  T^hr  ~  CAf{0, 1).  By  comparing  (l)-(2)  with 
(7)-(8),  we  can  see  that  the  problem  structure  without  the  use 
of  the  optimal  structure  of  F  is  the  same  as  that  with  its  use 
although  there  is  a  reduction  of  the  problem  dimension  in  the 
latter  case. 

3.2.  Iterative  WMMSE  Algorithm 


and  X2  has  the  same  form  as  Xi  but  with  the  indices  1  and 
2  exchanged.  The  source-relay  optimization  problem  for  the 
two-way  relay  system  is  now  formulated  as 

min  -Tsum  =  -r2i  -  ri2  (4) 

F.Rx; 


The  Lagrangian  function  of  the  optimization  problem  (4)  with 
respect  to  A  (or  equivalently  F)  only  is 


Li(A) 


1 

2 


log2  det  Xi 


1 

2 


log2  det  X2  +  v(pR-  Pr) 
(9) 


where  77  €  M  and  rj  >  0.  The  differential  of  Ti(A)  can  be 
expressed  by 

+d{v{PR  -  Pr))  (10) 

We  now  consider  the  following  problem 

min  Tr(WiXri) +  Tr(W2X2'^)  (11) 

A 

S-t.  Pr  <  Pr,  where  W^,  i  =  1,2,  are  fixed  weighting  ma¬ 
trices.  It  is  known  that  X^^  is  the  covariance  matrix  of  the 
linear  MMSE  estimate  of  S2  using  yi,  and  X^^  is  the  co- 
variance  matrix  of  the  linear  MMSE  estimate  of  Si  using  y2. 
So,  the  problem  (11)  is  referred  to  as  WMMSE  (weighted 
MMSE)  problem.  The  differential  of  the  Lagrangian  function 
L2{A)  of  the  problem  (11)  can  be  expressed  by 

dL2{A)  =  -Tr(Xj-iWiX^i9Xi) 

-Tr(X^iW2X^i5X2)  +  d{R{pR  -  Pr))  (12) 


where  S  M,  j/  >  0. 

By  comparing  (10)  with  (12),  we  see  that  the  problem  (4) 
with  respect  to  A  only  is  equivalent  to  the  WMMSE  problem 
(11)  if 


Wi  = 


2  In  2 


-Xi  and  W9  = 


2  In  2 


rXo 


(13) 


Now,  given  any  choice  of  A,  it  is  a  standard  task  to  deter¬ 
mine  the  linear  MMSE  equalizers  (receivers):  Qi  of  yi,  and 
Q2  of  y2,  and  easy  to  determine  Wi  and  W2. 

With  any  given  and  for  i  =  1,2,  the  WMMSE 
problem  (11)  becomes  equivalent  to 


nhn  J  =  Tr(^WiE[(Qiyi  -  S2)(Qiyi  -  82)^]) 

+Tr(w2E[(Q2y2  -  Si)(Q2y2  -  si)^])  (14) 


S-t.  Pr  <  Pr,  which  can  be  used  to  find  the  optimal  A.  More 
specifically,  by  inserting  (1)  and  (2)  into  (14),  we  can  show 
that  the  problem  (14)  is  equivalent  to 

min  J  =  a^Sa— c^a  — a^c  + d  (15) 

a 

s.t.  a^SRa  -  Pr  <  0,  where  a  =  vec(A),  Sr  = 
+  G2rR.,G^r  +  I)*  0  I,  S  =  Si  +  S2, 

c  =  Cl  +  C2,  d  =  di  +  d2.  Si  =  (Gi*7{Ra;* G(f^)*  0 

(Gf,QfW,Q,Gffi)  +  I  0  (G«  QfW,Q,Gffi),  c,  = 
vec(Gf,QfW,R|G,^^),  and  d,  =  Tr(W,Q,Qf)  + 
Tr(Wi).  Here,  we  have  used  i*  =  {i  —  l)mod  2  +  1-  The 
problem  (15)  is  a  simple  convex  problem. 

Therefore,  the  iterative  WMMSE  algorithm  is:  1)  find  Qi 
and  Wi  for  i  =  1, 2  assuming  a  fixed  A;  2)  find  a  new  A  by 
fixing  the  previously  found  Qi  and  Wi  for  i  =  1,2;  and  3) 
go  back  to  step  1)  until  convergence. 


4.  SOURCE  OPTIMIZATION  WITH  FIXED  RELAY 


In  this  section,  we  consider  the  optimization  of  Ra;^  and  R^j^ 
with  a  fixed  F.  We  can  rewrite  the  problem  (4)  with  respect 
to  Ra;j  and  Ra,^  only  as  follows: 

min  —  log2det(I-f  HRa,H^) 

RxtO 

S.t.  Tr(BiRa,Bf )  <  Pi,  7  =  1,2, 3  (16) 


where  Ra;  =  diag(Ra:i,  Raja),  H  =  diag(Hi,H2),  Bi  = 
diag(I,0),  B2  =  diag(0,I),  B3  =  diag(Gi,G2),  Hi  = 
(Hf^F«Hf2(Hfl2FF«Hf2  +  I)-iH«2FHi«)  J,  H2  = 

(Hf^F«Hfi(HfliFF«Hfi  +I)-iHKiFH2fl)^  Gi  = 
FHi/j,  G2  =  FH2fl,  and  P3  =  Pr  —  Tr(FF'^).  According 
to  Theorem  1  in  [5],  we  can  use  the  generalized  water- filling 
algorithm  to  obtain  the  solution  to  (16). 

Note  that  if  we  allow  Ra;  to  be  an  arbitrary  positive- 
semidefinite  matrix,  we  can  show  that  the  solution  to  the 
problem  (16)  is  always  such  that  Ra;  is  block  diagonal.  As¬ 


sume  Ra; 


Rxi  R 

R"  R.a 


Using  the  Fischer’s  inequality. 


we  have 


det(I  -f  HRa;H^)  <  det(I  -f  Hdiag(Ra;a ,  Ra;^  )H^)  (17) 

which  says  that  the  off-diagonal  blocks  of  Ra;  can  only  reduce 
the  sum  rate.  Furthermore,  we  can  write 

Tr(BiRa;Bf)  =  Tr(Bidiag(Ra;a,Ra:2)Bf ),  7  =  1,2,  3 

(18) 

which  says  that  the  off-diagonal  blocks  of  Ra;  do  not  affect 
the  power  constraints.  Therefore,  the  optimal  solution  of  the 
problem  (16)  must  be  such  that  Ra;  is  block  diagonal. 


5.  SIMULATION  RESULTS 

We  measure  the  performance  of  an  algorithm  by  its  time- 
capacity  curve.  A  point  on  the  curve  corresponds  to  the  time 
required  to  obtain  the  corresponding  achievable  capacity.  It  is 
important  to  note  for  any  given  set  of  source  covariance  matri¬ 
ces  and  the  relay  matrix,  there  is  a  corresponding  achievable 
capacity.  With  a  properly  placed  check  point,  any  optimiza¬ 
tion  algorithm  or  program  can  iteratively  generate  a  sequence 
of  these  sets  of  matrices,  corresponding  to  a  sequence  of  val¬ 
ues  of  achievable  capacity,  and  also  another  sequence  of  time 
stamps.  These  two  sets  of  sequences  can  be  gathered  via  sim¬ 
ulation  and  illustrated  as  a  time-capacity  curve. 

We  now  present  a  comparison  of  the  time-capacity  curves 
of  the  three  algorithms  for  relay  optimization:  iterative 
WMMSE,  hybrid  gradient  and  zoomed  SDR  The  zoomed 
SDR  algorithm  is  a  fast  variation  of  the  algorithm  developed 
in  [8]  for  single  antenna  sources.  The  details  of  both  hybrid 
gradient  and  zoomed  SDR  are  available  in  [10].  We  assume 
N  =  1  and  M  =  5  for  this  comparison. 


Fig.  2  compares  the  time-capacity  curves  of  the  three  al¬ 
gorithms  using  an  arbitrary  realization  of  all  channel  matri¬ 
ces.  All  elements  of  the  channel  matrices  H^j, 
and  Hij2  were  randomly  generated  according  to  CJV{0, 1). 
This  figure  shows  that  iterative  WMMSE  is  much  faster  than 
hybrid  gradient  when  the  capacity  is  not  near  optimal,  but  the 
opposite  is  true  when  the  capacity  is  near  optimal.  This  figure 
also  shows  that  the  zoomed  SDP  algorithm  is  much  slower 
than  both  iterative  WMMSE  and  hybrid  gradient. 

Eor  Eig.  3,  we  assumed  N  =  2  antennas  at  each  of  the 
two  source  nodes  and  M  =  6  antennas  at  the  relay  node.  This 
figure  compares  the  final  (i.e.,  after  convergence)  achievable 
capacities  under  four  schemes:  no  optimization,  source  opti¬ 
mization  only,  relay  optimization  only,  and  joint  source-relay 
optimization.  When  not  optimized,  the  source  covariance  ma¬ 
trices  were  randomly  generated,  and  so  was  the  relay  matrix 
except  that  the  structure  in  (5)  was  always  used.  In  this  exam¬ 
ple,  the  relay  optimization  beyond  (5)  appears  more  effective 
than  the  source  optimization. 

6.  CONCLUSION 

We  have  presented  a  technique  for  joint  source-relay  opti¬ 
mization  for  a  non-regenerative  two-way  MIMO  relay  sys¬ 
tem.  The  source  covariance  matrices  and  the  relay  matrix 
are  optimized  alternately  until  convergence.  The  source  opti¬ 
mization  with  fixed  relay  follows  a  generalized  water  filling 
algorithm  developed  in  [5].  Eor  the  relay  optimization  with 
fixed  source,  we  have  developed  a  novel  algorithm  called  it¬ 
erative  WMMSE  algorithm.  This  algorithm  is  shown  in  simu¬ 
lation  to  have  a  faster  convergence  rate  than  a  hybrid  gradient 
algorithm  when  the  results  are  not  near  optimal,  but  a  slower 
convergence  rate  when  the  results  are  near  optimal.  However, 
both  of  the  new  algorithms  are  much  faster  than  a  prior  algo¬ 
rithm  developed  in  [8]  for  single  antenna  sources. 


Sum  Rate  (bits/s/Hz) 

Fig.  2.  A  comparison  of  time-capacity  curves  of  iterative  WMMSE, 
hybrid  gradient  and  zoomed  SDP.  The  time  was  measured  in  seconds 
by  running  the  three  algorithms  on  a  desktop  PC. 


Fig.  3.  Comparison  of  averaged  sum  capacities  under  four  schemes: 
no  optimization,  source  optimization  only,  relay  optimization  only, 
and  joint  source-relay  optimization.  The  average  was  done  using  50 
randomly  generated  channels.  Here,  P\  =  P2  =  Pr  =  P  €  [2,  20] 
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